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ABSTRACT 



We study the effect of filter zero-point uncertainties on future supernova dark energy 
missions. Fitting for calibration parameters using simultaneous analysis of all Type la 
supernova standard candles achieves a significant improvement over more traditional fit 
methods. This conclusion is robust under diverse experimental configurations (number 
of observed supernovae, maximum survey redshift, inclusion of additional systematics). 
This approach to supernova fitting considerably eases otherwise stringent mission cali- 
bration requirements. As an example we simulate a space-based mission based on the 
proposed JDEM satellite; however the method and conclusions are general and valid 
for any future supernova dark energy mission, ground or space-based. 



Introduction 



The discovery of the acceleration of the expansion of the universe (jRiess et al. 



1998 



Perlmutter et al 



19991 ) ranks as one of the most significant recent discoveries in cosmology. This acceleration is 
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usually ascribed to a mysterious "dark energy" about which almost nothing is known although 
there are many competing ideas; what is needed to distinguish between them and shed more light 
on the nature of the acceleration is more and improved data. Observations of type la super- 
novae (SNe la) have a llowed the discovery of the acceleration of the ex pansion (IRiess et al.1 Il998l ; 
Perlmutter et al.lll999l ) and are currentl y the most established a nd best |Albrecht et al.ll2006r). The 



method is described by many auth ors (jPerlmutter et al 
1999 



1997 



Riess et al 



1998; 



Perlmutter et al 



Perlmutter fc Schmidtl l2003l ) and is based on the fact that SNe la are, t o good a c curacy 



standardizable candl e s (fo r a review of SNe la as standardizable candles see iPhillipd (|2003l ); 
Branch &: Tammannl (|1992l )). However current supernova observations are limited by systematic 
uncertainties; while this was not a problem when the supernova sample was small and statisti- 
cal uncertainties were the dominant ones, the growing sample size has already reached the point 
when statistical and systematic uncer tainties are of com parable magnitude, as in e.g. the combined 



sample of 557 supernovae studied bv lAmanullah et al.l (The Union2 compilation: [201C]). As more 
supernovae will be discovered in the future the need to better characterize and reduce systematic un- 
certainties will become the dominant concern in dark energy experiments. This has been recognized 
for several years, an d the SuperNova/Acceleration Probe (SNAP) satellit^](SNAP Collaboration: 
Aldering et al.ll2004l ) was proposed as a systematics-controlled space-based experiment that would 
put much tighter constraints on dark energy than current and near future experiments by following 
~ 2000 supernovae out to z max ~ 1.7. More recently NASA and the Department of Energy have 
announced the Joint Dark Energy Mission (JDEM) as a future space-based mission to study the 
nature of dark energy by employing a combination of techniques including supernovae. Therefore it 
is important to characterize the s ources of systematics of future supernova experiments; studies of 
this k ind have already appeared (|Kim et al.l I20Q4J : iKim &: Miquell 120061 : iNordin et al.ll2008l ; iLinder 
20091 ) and this paper aims at building upon and e xpanding them. Studies using real data-sets have 
also appeared: for example iKilbinger et al.1 (120091 ) use the SNLS supernovae in (jAstier et al.ll2006l ) 
to evaluate the effect of zero-point uncertainties on the final cosmology. 

The two most important sources of systematic uncertainty in dark energy experiments that 
use supernovae are the dimming by dust in the host galaxy and uncertainties in the flux calibra- 



tion, s p ecifically the filter zero-po i nts, as seen in re c ent c os mological ana l yses s u ch aslAstier et al 



(2006), IWood-Vasev et al.1 (|2007l ). Kowalski et al.l (|2008l ). Ifficken et al.l (|2009l ). lAmanullah et al 



(J201CJ). The problem of host-galaxy di mming is also being aggressively pursued, by e.g. targeting 
supernovae in rich clusters of galaxies (jDawson et alJl2009l ): we will include it statistically in our 
analysis but will not go into its systematics. Properly taking into account zero-point uncertain- 
ties is nontrivial because their causes are numerous, ranging from any inaccuracy in the response 
function of telescope, filter, or detector (from now on collectively indicated as "channel"), or the 



http 


/ / www . snap . lbl . go v/ 






^http 


// j dem . gsf c . nasa . gov/ 






''http 


// jdem.lbl.gov/ 



- 3 - 



atmosphere for ground-based experiments, to uncertainties in the calibration procedure. While 
accurately characterizing all these is obviously an experiment-dependent problem, our aim is to 
provide a more general way to deal with them. 

Starting with a simple model of zero-point uncertainty, we perform a complete end-to-end 
simulation of a supernova dark energy mission, propagating zero-point uncertainties through the 
simulation chain, and we evaluate its effects on the final cosmology fit. We do not aim at a detailed 
physical modelling of particular causes of uncertainty such as imperfect knowledge of the standard 
stars used to calibrate the zero-points or of the filter response functions, but rather at characterizing 
their overall effect, whatever their underlying reasons, with a set of zero-points representing the 
contribution of these important sources of systematics to the final error budget. This will serve 
as a guide to designers of how much specific components (telescope, filters, detectors, calibration 
procedure and so on) could be imperfectly known and still achieve the mission objectives. 



Our starting point is the result bv lKim fc Miquell (|2006l . hereafter KM). KM introduce a new 
model of filter zero-point uncertainty and show that, due to the standardizable candle nature of 
SNe la, it is possible to treat these uncertainties as parameters that can be included with other 
parameters in a cosmology analysis. More precisely, KM model the observed peak magnitude m 
of a supernova as m = \x + M + Other + Z where fj, is the distance modulus, M is the absolute 
magnitude after standardization (and therefore the same for all supernovae), 11 Other" indicates 
all residual effects that influence m, such as host galaxy extinction, and Z is a new fit parameter 
for zero-point offsets to be fit with all the other parameters in the model. It is important to 
note that modelling zero-point offsets as fit parameters would not be possible if SNe la were not 
standardizable candles because M would not be the same for every supernova. KM show that by 
fitting for all the supernovae distance moduli simultaneously it is possible to achieve a significant 
reduction in the final uncertainties in the cosmological parameters with respect to the traditional 
case when supernova distances are fit one by one and calibration uncertainties are then included 
in the total error budget. In the rest of the paper we will refer to the KM fitting approach as 
"simultaneous fit" and to the traditional approach as "SN by SN fit" . 

This work expands KM in several ways: 



1. KM carry on a Fisher matrix analysis of their model; we perform a complete end-to-end 
simulation of a supernova dark energy mission, with a realistic modelling of all its aspects. 

2. KM use a particular z distribution, in which all supernovae are placed at those special redshifts 
that have zero ET-correction. At those z the improvement in mission performance is maximum; 
we study a more realistic z distribution. 

3. We include an intrinsic color dispersion. 

4. We investigate whether our conclusions are robust with respect to several changes in mission 
parameters (number of supernovae, maximum redshift, inclusion of additional systematics); 
our simulation tool allows us to explore a much wider parameter space than KM. 
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It is important to point out that the KM model that we adopt here is applicable to a generic future 
dark energy mission based on supernovae; however, for concreteness we will present our results by 
considering a specific example: the supernova survey of the future space-based dark energy mission 
based on the proposed SNAP satellite. We will also assume that a nearby sample of supernovae 
whose characteristics ar e based on the expected Nearby Supernova Factory sample^ ( Aldering et al 



2002 



Copin et al.ll2006l ). is available: specifically this sample is comprised of 316 supernovae with 



0.03 <z< 0.08. 

The paper is organized as follows: Section [2] describes the KM model and its implementation in 
our simulation tool, Sections [3] and U] describe our results and Section [5] summarizes our conclusions 
and discusses ways the work can be expanded. In what follows we will use the terms "mission" and 
"experiment" interchangeably. 



2. Supernova model and implementation 

Our analysis begins with a set of supernova statistics (peak magnitudes and stretches) in 
different bands, representing both the distant sample that our simulated mission will observe and 
the nearby sample that we assume already available; these statistics are obtained in the following 
way. For each supernova a redshift is chosen from a specified redshift dis tribution and fluxe s and 



their uncertainties are computed by convolving spectral templates from iHsiao et al.l (|2007l ) with 
the channel throughputs; this results in a set of simulated supernova fluxes in different bands at 
different epochs. The flux variability due to Poisson noise is simulated by drawing the fluxes from 
a Gaussian distribution, which is appropriate in the limi t of high expected num bers of photons. 



Each band is then fit independently of the others, following iPerlmutter et al.l (119991 ). to give, among 
other parameters, an estimated flux at maximum and a stretch in each band; the covariance matrix 
is also computed and propagated later. Up to and including the stage of light curve fitting, the 
two approaches, simultaneous fit and SN by SN fit, do not differ and they are carried out in the 
same way by our analysis. We then fit for the distance moduli (hereafter u fi fit"); this is the step 
where the differences in the two approaches are manifest, and we describe the models we used for 
each approach in more detail in the next two subsections. We then describe the data error model 
used both by the [i fit and the cosmology fit, the cosmology fit itself, which again is performed in 
the same way for simultaneous fit and SN by SN fit, and finally the mission parameters we use. In 
the rest of the paper A^n will denote the number of supernovae observed by the mission, excluding 
the nearby sample and N = N^n + -^Nearby will denote the total number of observed supernovae. 
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2.1. Simulating the zero-point uncertainty in the SN by SN fit: a Monte Carlo 

approach 

In this section we present how the SN by SN analysis is performed. After converting fitted 
peak fluxes to magnitudes we model these and the stretches as: 

m* fc = n { + a(S i -1) + M(zi) k + A v i a(zi) k + B v t b(z i ) k 
s\ = S\ (1) 

with i = 1 • • • N; for each supernova i, k belongs to the subset of {1 • • • Np} that covers restframe 
optical and near infra-red (NIR) wavelengths and N-p denotes the number of filters used in the 
mission; in our simulations we assume Np = 8. The meaning of the symbols in Equations [T] is as 
follows, distinguishing between input data, model parameters, and known functions. 



1. Input data from simulations: 

(a) rri\ denotes the simulated peak instrumental magnitudes of supernova i in observer 
frame band k obtained after light curve fitting. 

(b) s l k denotes the stretch of supernova i in observer frame band k after light curve fitting. 

2. Model Parameters: 

(a) [i l denotes the distance modulus of supernova i. 

(b) S l is a weighted stretch parameter for supernova i used to fit for unlike s l k which 
depends on the observer frame band, there is a single parameter S l for each supernova. 



(c) Ay 1 a nd By 1 = (Ay /Ry) 1 are extinction parameters (CCM: ICardelli. Clayton, Mathis 



1989). 



3. Known functions: 

(a) M(zi)k is the absolute peak magnitude of a S = 1 supernova at redshift z% in observer 
frame band k, given by: 



-2.5 log (J dXf((l + Zi )X)T k (X) 



M( Zi ) k = -2.5 log / dA/((l + Zi)\)T k (X) (2) 



where /(A) is a template spectrum from lrlsiao et ali (j2007l ) and T k (X) is the throughput 
of channel k, with A the observer frame wavelength. 

(b) a(zi) k and b(zi) k model host galaxy extinction and are computed in a manner similar to 

M( Zi ) k : 

a( Zi ) k = -2.5 log (^J dXa C CM((l + z i )X)f((l + z i )X)T k (X) 
b( Zi ) k = -2.5 log ( /dA6 C cM((l + ^)A)/((l + z i )A)r fc (AU C>,) 
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where cjccm(A) and &ccm(A) are known functions of wavelength, describing host galaxy 
extinction; we assume a CCM extinction law. 

(c) a is a fixed dimensionless constant; we assume a = —1.7. 

For each supernova i = 1 ■ ■ ■ N we fit for fj,, S, Ay, and By. 

Our chosen value for a was based on older values and is somewh at larger, in absolute v alue, 



than those found by recent analyses of supernova data: for example iKowalski et al.l (120081 ) find 
a = —1.46 ± 0.16 (note that with our sign convention in Equations [T] a < 0) for the supernovae in 
the z > 0.2 Union subsample, which is the relevant one since in our subsequent analyses we will 
assume z > 0.3. This may result in a conservative parameter estimation in all our simulations but 
would not change our conclusions. 

We now include zero-point uncertainties, which are not described in the system of Equations 
[TJ The usual approach to incorpora ting zero-point uncertai nties is to estimate them and include 



them in the total error budget (see lAmanullah et al.1 (|2010l ) for an attempt at jointly modelling 



zero-point uncertainties and other systematics taking their covariances into account). Following 
KM we implement the usual approach by modelling the zero-point uncertainty in each bandpass k 
via a peak magnitude shift, described by a parameter Z k , for supernova i in observer frame band 
k. 

m\ -> m l k + Z k , Vi (4) 

where Z k is a random shift drawn from a Gaussian distribution with mag mean; the value of its 
standard deviation quantifies our prior knowledge of the filter zero point uncertainty, oz- Since the 
light curve fitter fits for a peak flux, fo k = 1 o _0 - 4m '=( max ) , the magnitude shift is actually converted 
to flux before being applied, according to the usual expression: 

fok -»• fok x 10-°- 42fc -, (5) 

The same magnitude shift Z k affects all supernovae that are observed through filter k\ since this 
band in the restframe varies from supernova to supernova depending on their redshifts, the same 
Z k affects different supernovae in different ways, introducing a correlation between their distance 
moduli /u. Neglecting for the moment other sources of variability, for supernova i we may write: 
//' = m't — M(zi) k , where M(zi) k is defined in Equation [2j Then as m l k — > m l k + Z k => /u* — > 
fj, 1 + Z k ; the [is become correlated via the Z k parameters and their covariance matrix becomes 
non-diagonal. 

The contribution of the filter zero-point uncertainty to the overall [i covariance matrix is 
estimated via a Monte Carlo approach (MC): at each MC realization a different set of magnitude 
shifts Z k , one for each filter, is drawn from a Gaussian distribution with mag mean and a chosen 
standard deviation; we run the MC with standard deviations ranging from 0.001 mag to 0.05 mag; 
each MC run is iterated 500 times. 



In principle the MC should be run on the actual data sample; however the large dimension of 
future datasets (up to 2000 supernovae in our simulations) makes this approach impractical. We 
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chose instead to run the MC on a smaller sample of supernovae, to derive a [i covariance matrix for 
this smaller dateset, and to calculate the jx covariance matrix for the larger dataset by interpolating 
the matrix computed for the smaller one. 

More specifically we proceed as follows: 

1. Generate a set of supernovae, labelled by a, at redshifts z a = 0.01 . . . 1.7 in increments of 0.01; 
each supernova has a stretch S = 1 and no extinction so that the only source of variation in 
the dataset is the one introduced by the filter zero-point uncertainty. 

2. Fit the light curves of these supernovae and obtain the flux at maximum /gfc in filter k. 

3. Run the MC: at each realization v a different set of magnitude shifts Zk is generated, converted 
to flux, and applied to /o& as in Equation El 

4. Fit for the distance moduli Li a k at each realization v; repeat steps 3 and 4 for 500 realizations. 

5. At the end of the MC, compute a \x covariance matrix in the usual way: for a pair of supernovae 
denoted by a, b: 

(V Z p)o 6 = (MV)-(M a )(M 6 ) J (6) 



where 



, N NR 



1 AW 



iVNR 



and iV N R = 500. 



The covariance matrices thus computed are stored for use with the full dataset. For each pair 
of supernovae i, j, at redshifts Z{, Zj, in the full dataset, an entry of (Vzp)y is computed by 
spline interpolating the matrix defined in Equation [6] between redshifts z a ,Zb and z a +i,Zb+i with 
z a ^ z i ^ z a+ \ and z\, ^ Zj ^6+1 5 this matrix is added to the statistical fx covariance matrix, 
and to any o ther covariance matrix d escribing some systematic, Vs ys , such as the systematic model 



described in iLinder fc Hutererl (|2003l ) 



Figure [T] shows, in the upper panel, the square root of the diagonal elements of the covariance 
matrix computed via Equations [7J a a = a/ ({n a ) 2 ) — if 1 ' 1 ) 2 7 for different values of the zero-point 
prior oz- The high values of these elements compared with the values of the prior, especially at 
high z (e.g: a a 0.5 mag at z 1.6 for oz = 0.05 mag) is explained by the dust model we adopted: 
a CCM model in which we fit both for Ay and for By = Ay/Ry. As an alternative one could fix 
Ry and fit only for Ay when running the MC; we tried this as well, fixing Ry = 3.1, and obtaining 
values of o a a factor of 3.5 lower than those obtained when fitting for By, these results are shown 
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in the lower panel of Figure [H plotted on the same scale as the upper panel to show the difference. 
In the results we report later for the SN by SN fit we always use covariance matrices obtained by 
fitting By in the MC. In both cases the curves are roughly proportional to each other by the ratio 
of their zero-point priors. 



2.2. Simulating the zero-point uncertainty in the simultaneous fit 

The model we adopt to describe our simultaneous fi fit, taken from KM, is the following: for 
TV observed supernovae, with supernova i observed in a set of filters k = 1 • • • Np, we have: 





= fj, 1 + a(S 1 - 


1) + M(zi) k + A v l a(zi)k + ByHizxju + Z k 


s 1 k 


= S 1 




m N k 


= n N + a(S N 


— \)+M (z N ) k + A v N a{z N ) k + B v N b{z N ) k + Z k 


s\ 


= S N 




obs 

k 


= %k, 





2° s k = 2, k , (8) 

The meaning of the symbols that also appear in Equations [T] is the same and the effect of the 
filter zero-point uncertainty is modelled by the set of parameters Z k , one for each filter. This 
contrasts with the SN by SN case where the Z k are treated as random magnitude shifts chosen 
from a defined probability distribution and added to the peak magnitudes. Z oh>i k are measured 
zero-point values and their uncertainty is described by a measurement covariance matrix Vz', in the 
following we assume Z ohs k = mag. The covariance matrix Vz may or may not be diagonal; the 
diagonal case Vz = diag(o"i 2 • • • <7jv P 2 ) (for Np filters) amounts of course to assuming that the filter 
zero-points uncertainty are all uncorrelated. This simple assumption is made in KM and, while it 
is too simplistic, deriving a more realistic model would require a detailed knowledge of the actual 
experiment. I n our analysis we w i ll not try to do that but will rather consider uncorrelated zero- 



points (but see lSamsing fe; Linderl (|2010l ) for an attempt to model the effect of correlated zero-point 
uncertainties between filters via Principal Component Analysis). In writing down Equations [8] we 
have implicitly assumed that the zero-points do not vary in time and therefore can be represented by 
a single set of Z k parameters. This is a reasonable assumption for the space-based mission we will 
consider in our simulations, but may not be not be for other experiments; for example in a ground- 
based experiment zero-points may be expected to vary with atmospheric conditions. However, 
even in the case of time-varying zero-points the KM can still be used; in the ground-based case 
mentioned above one may introduce separate sets of Z k for a set of different atmospheric conditions 
and assign a set to each supernova depending on these conditions on the date of observation; other 
cases where this approach can be used are modelling changes in the instrument during a very long 
mission or combining different experiments. 

Equations [8] form a linear system of 2(A r obs) x N observations and iVp ar = 4 x N + A^f 
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Fig. 1. — Zero-point covariance matrices standard deviations a a derived from MC, for different 
values of the zero-point priors, as a function of redshift. Upper panel: fitting for By = Ay/Ry. 
Lower panel: fixing Ry = 3.1. The two panels have the same scale to show how fitting for By 
significantly increases a a . 
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parameters, where (-/Vobs) is the mean number of observed bands used in the fit per supernova 
(~ 5 in our simulations), the factor of 2 is there because for each band we have a peak magnitude 
and a stretch, and the factor of 4 is there because each supernova is described by four parameters 
fi, S, Ay, By in addition to the zero-point parameters Z^. For a typical stage IV space-based dark 
energy mission this may translate to ~ 22000 observations and ~ 9000 parameters; fortunately the 
Fisher matrix of the system of Equations El whose inversion is the main computational hurdle in 
implementing the KM model, is very sparse since the only non-zero entries come from 4x4 matrices 
along its diagonal, corresponding to the supernova parameters, and from the entries whose row 
or column index correspond to the zero-point parameters that introduce correlations among the 
supernovae; therefore the total number of non-zero entries scales as N, not iV 2 ; the solution of the 
system of Equations [8] can therefore be accomplished in about one hour on a 3 GHz desktop with 
16 GB of memory. 

Note that when Vz — > the supernovae in the system of Equations [8] become decoupled and the 
model reduces to the traditional SN by SN fit; the cosmology fit results of the two approaches must 
then be the same; mathematically the entries in the Fisher matrix whose row or column indices 
correspond to the zero-point parameters Z\~ become zero and the Fisher matrix itself becomes block 
diagonal, with a 4 x 4 non zero block for each supernova. 



2.3. Modelling the input data uncertainties 

We have so far focused on the zero-point uncertainties, but other sources of uncertainty affect 
the measured magnitudes in each band. The most important of these are: measurement errors due 
to Poisson noise (which was approximated as a Gaussian in our simulation tool), a possible color 
uncertainty, any remaining statistical uncertainty, and any remaining systematic not described by 
our model. 

We model the remaining statistical uncertainties by assuming an intrinsic dispersion doisp = 
0.1 mag for each supernova in the dataset after stretch and color correction; this value is consistent 



with values of intrinsic dispersion used by recent surveys such as ESSENCE ( Wood-Vasey et al 



20071 ) and is also used by the Dark Energy Task Force (DETF: lAlbrecht et al 



200J) for stage IV 



experiments such as JDEM. 

We then include the possibility of an intrinsic color dispersion, which is not modelled by 
adding the same intrinsic dispersion to each supernova, since this affects each band in the same 
way. Instead we model an intrinsic color dispersion by adding a new, in principle non-diagonal 
covariance matrix to the diagonal Poisson measurement covariance matrix before fitting for the 
model described by Equations Therefore we have the following model of input data uncertainties: 
Vsn Data = Vp isson + Vg c . For simplicity we will consider only Vg c = diag(5 2 ) where 5 C is a constant. 
Note that in spite of its form V$ c affects supernovae at different z, and therefore observed in a 
different number of bands, differently: this color uncertainty model contributes to a magnitude 



-11- 



uncertainty of ~ V^obs^c for a supernova with iV bs measured bands. In our analyses we will 
consider both 5 C = and 5 C 7^ 0. 

After performing the linear fj, fit described by Equations [8] with Vsn Data as data covariance 
matrix, the covariance matrix from the fit, Vu,, is added to the matrix representing the 0.1 mag 
supernova intrinsic dispersion described above, obtaining the matrix Vcosmology Fit = + Vbisp> 
where Vbisp = diag(0.1 mag). This is then used as the data covariance matrix for the cosmology 
fit described in Subsection 12.41 below. The cosmology fit is also the place where possible additional 
systematics are taken into account, by adding an appropriate covariance matrix to Vcosmology Fit (see 
Section [2.4p . The SN by SN case is handled slightly differently: for each supernova i, the distance 
modulus // is derived independently by fitting the model described by Equations [TJ along with a 
covariance matrix V % „ that does not include the effect of zero-point uncertainties. The uncertainties 
in /I 1 derived from V 1 ^ are combined in a single diagonal matrix and zero-point uncertainties are 
included by adding a non-diagonal matrix obtained by interpolation of the matrix Vzp, obtained 
from the MC, as described in Subsection l2,lt Vbi sp and possibly other systematics are then included, 
and the cosmology fit is performed. 



2.4. Cosmology fit 



We fit to a flat cosmology with Dark Energy Equation of state (EOS) parametrized by w(a) = 
wo + w a (l — a) where a = 1/(1 + z) is the scale factor, with a prior on the reduced distance to the 
last scattering surface (g?lss) a * Z LSS = 1089 with a 0.2% fractional uncertainty where: 



^lss = V^mh 2 



^LSS 



dz 



O m (l + z) 3 + (l-O m )exp(3 j Q z 



l+w(z') 
l+z> 



dz') 



(9) 



This gives an ex cellent representation of the expected Planck C MB constraints for combining with 
supernova data (jLinder fc Robbers! 120081 ; Ide Putter et al.ll2009i ). 



We chose a fi d ucial flat ACDM cosmology with £l m = 0.3, consistent with the value found 
by iKowalski et al.l (|2008l ) when fit ting for such a cosm ology. For presenting our results we use 
the DETF Figure of Merit (FoM: lAlbrecht et al.l 120061 ) as the reciprocal of the square root of 
the determinant of the covariance matrix after marginalization to WQ,w a . This now allows us 
to investigate the effect of zero-point uncertainties in supernova experiments to understand dark 
energy. 



2.5. Mission simulation 



While we have so far been quite general in describing our zero-point uncertainty model, we 
now focus on a specific example of a mission. We choose to simulate a space mission based on 
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the proposed SuperNova Acceleration Probe@ (SNAP) satellite ( Aldering et al. 2004 ). but with a 
different configuration than the one described there. The most important differences with the 
original SNAP proposal concern the telscope aperture, the number of filters, the maximum survey 
redshift, and the redshift distribution; these choices are based (at the time this paper is written) 
on what the future JDEM mission may look like. The most important mission parameters we used 
are reported in Table Q3 

The throughputs of the eight channels are shown in Figure [2j these are the transmission of the 
telescope+filter+detector combinations. 



3. Results 

We use our simulation tool to explore a larger parameter space than KM. In particular we 
want to: 

1. Compare the two fit methods as a function of zero-point uncertainties for a baseline mission, 
modelled on the SNAP satellite, with realistic z distributions. We show that the simultaneous 
fit greatly outperforms the SN by SN fit; therefore we will concentrate on the simultaneous 
fit in the subsequent analyses. 

2. Investigate how the FoM, for the simultaneous fit, varies as mission parameters are changed; 
in particular we focus on the effects of 

• maximum survey redshift z max . 

• number of supernovae observed by the mission, iVgN. 



3. Includ e additional systematics. We will focus on the systematics model described in lLinder Huterer 



(|2003l ) (hereafter referred to as "LH systematic"). 



E http : / /snap . lbl . gov 



Table 1. Mission parameters. 



Telescope aperture 


1.5 m 


Exposure time 


1200 sec in four dithered exposure of 300 sec each. 


Cadence 


4 days 


Filters 


5 in the optical, 3 in the NIR 


Observed SNe la 


2000 with flat z distribution 
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Fig. 2. — Channel throughputs for the eight channels (Five optical and three NIR) assumed in the 
simulation; the transmissions refer to the telescope+filter+detector combinations. 
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3.1. Making the case for simultaneous fit: results for the baseline mission 

We now present the first main result of the paper: fitting for all supernovae at once vastly 
outperforms the traditional SN by SN fitting, in the sense that the FoM decreases much more slowly 
with increasing zero-point uncertainties in the simultaneous fit case. We present results for realistic 
mission parameters and four different values of the color uncertainty 5 C : 5 C = 0, 0.005, 0.01, and 
0.02 mag; the zero-points Zk are assumed uncorrelated; we always assume z max = 1-5. Our results 
are shown in Table [2j 

Several things are worth noting in Table [2j 

1. In the case of no zero-point uncertainty the two methods give the same result as they must, 
since in this case they are mathematically equivalent. 

2. The simultaneous fit vastly outperforms the traditional SN by SN both for 5 C = and for 
the more realistic case 5 C ^ 0. This point was already made by KM, but it is reassuring 
to see that we can confirm their result for a more realistic mission architecture and with a 
more sophisticated analysis. Therefore the numbers in Table [2] strongly argue for adopting 
the simultaneous fit as a general analysis method for future supernova surveys. 

3. For the not very realistic case of 5 C = mag the FoM for the simultaneous fit is almost flat 
as the zero-point varies. This is because in this case self-calibration works so well that the 
0.1 mag intrinsic dispersion dominates the error budget. In the more realistic case of 5 C ^ 
the simultaneous fit is still superior: the FoM does decline modestly because of the interaction 
of 5 C with Zk each of which affects bands rather than supernovae as a whole. 

To gain more insight into the working of this self-calibration mechanism we consider how 
the final statistical uncertainties on the fit parameters Z^ are related to the uncertainties on the 
zero-point priors az- Quantitatively we consider the subcovariance matrix of the Z parameters 
alone obtained from the /i fit: its determinant det(iJ) is simply the product of the eigenvalues of 
this submatrix and det(Z) 1 ^ NF , where Np = 8, should give an estimate of the typical statistical 
uncertainty in the fit parameters Z after the simultaneous [i fit; we call this determinant az Fit to 
emphasize this point. We compare az Fit with the uncertainty on the zero-point prior before the fit, 
a z j in Figure O the four lines show results for 5 C = 0,0.005,0.01,0.02 mag. The figure shows that 
for 5 C = 0, az Fit grows very slowly as a function of az- for az = 0.05 mag, az Fit = 2 x 10~ 4 mag; 
this explains the almost constant FoM as a function of az for S c = mag reported in Table [2j For 
5 C ^ az Fit is higher by a factor of 3 — 5 than the 5 C = mag case even at low az and grows 
more rapidly as az increases, but it is still much smaller than az- for example, for 5 C = 0.02 mag, 
at az = 0.05 mag, az Fit = 2 x 10~ 3 mag, a factor of 10 higher than the value for S c = mag, but 
more than 10 times smaller than az- Therefore Figure [3] shows both why 5 C ^ decreases the FoM 
as a z increases and why the simultaneous fit still outperforms the SN by SN fit. 

Because of the large parameter space we are exploring it is convenient to visualize our results 
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Fig. 3. — Typical statistical uncertainty on the zero point parameters Z after the fit, &z Fit) vs. 
uncertainty on the zero-point prior, erg, for color uncertainty 5 C = 0,0.005,0.01,0.02 mag. 
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as contour of constant FoM as a function of two parameters at the same time. An interesting 
combination of parameters to consider is given by the zero-point prior az and the color uncertainty 
5 C : their relative interplay indicates whether more effort should be expended in calibration or 
in understanding supernova colors. Figure H] shows contours of constant FoM as a function of 
the uncertainty on the zero-point prior az and the color uncertainty 5 C . The figure shows, not 
surprisingly, a trade off between these two parameters. What is more interesting is the nearly 
vertical shape exhibited by the graphs, indicating that it pays off to tightly control the color 
uncertainty: for example, to achieve a FoM of 240, limiting 5 C to J$ 0.013 mag results in very 
lax requirements on the zero-point uncertainty (between 0.01 mag — 0.05 mag), whereas poorer 
control of the color uncertainty 5 C <l 0.013 mag imposes strong requirements on the zero-point 
(j$ 0.01 mag); similar considerations hold for other FoMs. Therefore we see the existence of two 
regimes: the high az regime where tighter control of color uncertainty is more important, and 
the low a z regime, where tighter control of zero-point prior is more important; the transition 
between these regimes occurs when 5 C ~ az- For 8 C < (high az regime) the decline in the 
FoM is roughly 20(<5 C /0.01)% independent of Z\.\ in this regime the data themselves determine 
the zero-point more precisely via self-calibration and tighter control of color uncertainty lead to 
further improvements whereas tighter zero-point calibration is not essential. When az < 5 C (low az 
regime) self-calibration is not dominant and tighter zero-point calibration is necessary to achieve 
higher FoMs. 

This first conclusion for the baseline mission can therefore be drawn from Table [2] and Figure 
ID in order to have an impact above self-calibration alone, filter zero-point uncertainties must be 
similar to or better than the intrinsic color dispersion. 



4. Exploring the mission parameter space 

The second aim of this paper is to explore trades in mission design. In this section we wish 
to explore variations in several parameters from the baseline mission presented in Section [3l ana- 
lyzing the impact on the results. In particular we focus on two crucial parameters: the maximum 
survey redshift z max and the number of observed supernovae N^tss, while keeping the remaining 
parameters unchanged; we are particularly interested in different combinations of parameters that 
give comparable FoMs. This is a particularly interesting combination of mission parameters to 
consider because spectroscopically following up supernovae at high z is very time consuming since 
the required time scales as ~ (1 + z) e ; the parameters in Tabled] remain unchanged but the mission 
duration varies as z max and Nq,n change. 

We also wish to consider other sources of systematic uncertainty in addition to zero-point. A 



much used model of systematic uncertainty in supernova surveys has been presented bv lLinder &: Huterer 



(|2003l ) who introduce a redshift-dependent systematic that models, e.g., a non-standard luminosity 
evolution or time-varying host-galaxy dust extinction. Their model, which we will refer to as the 
LH systematic, assigns to each supernova in a bin of central redshift Zb and total width 0.1 an 
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Fig. 4. — Contours of constant FoM for different zero-point prior az and color uncertainties S c . The 
straight line at 45° shows the points where zero-point prior and color uncertainty are equal; note 
that the line intersects the contours roughly where they change their slope from almost vertical 
{pz > S c ) to almost horizontal (az < S c ). The case az > S c is the self-calibration regime: the data 
themselves determine the zero-point more precisely than an accurate zero-point calibration. In the 
case az < S c a tighter control of zero-point uncertainty is necessary to improve the FoM. 
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equal share in quadratur e of an uncertainty dm = 0.02(1.7/z max )(l + Z(,)/2-7. Adopting this model, 
Linder &: Hutererl (|2003l ) show that maximum survey redshifts of ~ 1.5 are necessa ry to convinc- 
ingly see evidence of a variation in w. The same model is used bv lKim et al.l (|2004l ) to describe a 
generic mission systematic, not necessarily due to time-varying host-galaxy extinction. We use the 
LH systematic in this spirit, namely to describe any other source of systematic not captured by our 
zero-point uncertainty model, and we repeat the same set of simulations described in this subsection 
with the LH systematic added. The covariance matrix for the cosmology fit Vcosmoiogy Fit is thus 
given by: Vcosmoiogy Fit = V fl + Vbisp + Vlh, and the LH systematic is given by: 

l + z b 



dm = 0.01- 



2.7 



(10) 



that is, we divide the LH systematic for z max = 1.7 by two since we include calibration uncertainty 
separately. It is important to note that by adding Vlh we are implicitly assuming that the LH 
systematic is uncorrelated with the other systematics; a more detailed treatme nt should aim at 



prope rly taking into account possible correlations; an example is described by lAmanullah et al 

fcoich . 



We now present our results obtained considering the Nsn , z mas[ , az combination, keeping in 
turn one of these parameters fixed, and varying the other two. In all cases we will report tables of 
FoM and contour plots of constant FoM made from these tables; all results will be given with and 
without the LH systematic. We will also assume in the following 5 C = 0.01 mag. When we keep 
iVsN fixed we choose iVgN = 2000; when we keep z max fixed we choose z max = 1.5. 



4.1. Influence of maximum survey redshift 2 max 

We consider surveys with z max = 1.1,1.2,1.3,1.4, and 1.5 always keeping the other mission 
parameters fixed. The results are reported in Table[3]with and without including the LH systematic; 
contour plots of constant FoM as a function of z max and oz at constant A§n = 2000 and 5 C = 
0.01 mag are shown in Figure [5] without including the LH systematic in the upper panel and 
including it in the lower panel. 

The upper panel of Figure [5] shows the existence of two regimes divided by FoM ~ 250: for 
FoM J$ 250 the contours are almost vertical, wheres for FoM <; 250 they become almost horizontal. 
The former is the self-calibration regime, where, as remarked, the data themselves determine the 
zero-point precisely; however self-calibration is less effective with increasing redshift because fewer 
filter observations are used for each supernova as z max increases. The figure suggests that if there 
is no redshift dependent systematic then not surprisingly z max becomes less important: a FoM 
= 250 could be achieved for oz = 0.05 mag and z max = 1.3. For FoM > 250 we are not in the 
self-calibration regime anymore and to achieve FoMs this high zero-point uncertainties must be 
tightly controlled {pz ~ 0.01 mag). 

The inclusion of the redshift dependent LH systematic however changes the conclusions above 
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Fig. 5. — Contours of constant FoM for different uncertainties on the zero-point prior az and 
maximum survey redshift z max . We assume iVsN = 2000 and 5 C = 0.01 mag. Upper panel: the LH 
systematic is not included. Lower panel: the LH systematic is included. 
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as shown in the lower panel of Figure [5j Apart from the obvious hit in the FoM it introduces 
(reducing it by ~ 70: clearly the LH systematic is dominant), there is also continuous improvement 
in FoM with higher z max . As expected, one can trade off az and .z max : a FoM 200 can be 
achieved either by az ~ 0.01 mag and z max ~ 1.5 or oz ~ 0.003 mag and z max ~ 1.3. The lower 
maximum survey redshift, with its reduced spectroscopic time, can achieve similar results if much 
more stringent zero-point requirements can be met. 



4.2. Influence of the maximum number of observed supernovae iVgN 

We consider surveys with iVsN = 1500,1800,2000 while keeping z max = 1.5. Table H] shows 
our results with and without including the LH systematic. Figure [6] shows the contour plots made 
from Table S] without including the LH systematic in the upper panel and including it in the lower 
panel. 

In the upper panel of Figure [6] we again see the existence of the two regimes distinguished by 
FoM ~ 250 we noted in Figure El this shows that that the larger the number of supernovae per 
redshift bin the better the self-calibration can be done. The figure shows that achieving FoM ^ 250 
requires a tight control of zero-point uncertainties gz ~ 0.01 mag, at least if one considers ./Vsn < 
2000. (We did not consider iVsN > 2000 because such numbers would probably be unrealistically 
high for a future space-based mission). For FoM ^ 250 on the other hand zero-point requirements 
are much less severe. The existence of these two regimes can once again be explained by self- 
calibration: for FoM ;$ 250 and oz ~ 0.02 mag we are in the self-calibration regime and the 
contours are therefore roughly vertical, indicating that the FoM is quite insensitive to the actual 
value of the zero-point prior az- In this regime it pays to increase iVgN; an increase of ~ 10 in FoM 
can be achieved by observing ~ 150 more supernovae, almost regardless of az- For FoM 250 and 
-^sn < 2000 we are not in the self-calibration regime anymore and the contours are almost flat: 
a tighter control of zero-point uncertainties is necessary to achieve higher FoMs. Figure [6] shows 
that in this regime an increase of ~ 500 supernovae, from 1500 to 2000 results in only less than 
~ 0.01 mag relaxation in the az requirement. 

Including the LH systematic does not change this conclusion much: from the lower panel of 
Figure [6] we again notice the overall decrease of about ~ 70 in FoM and we see that a tight control 
of zero-point uncertainties (az J$ 0.01 mag) is required to achieve FoM 200. Interestingly, for 
az <5 0.02 mag, to achieve an increase in FoM ~ 10, additional ~ 220 more supernovae are required 
(at least if uniformly distributed), compared with ~ 150 without including the LH systematic; this 
conclusion argues for observing mod est numbers of sup e rnova e at high z rather than many at lower 



z, consistent with the conclusions of lLinder &: Hutererl ((2003) 
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Fig. 6. — Contours of constant FoM for different uncertainties on the zero-point prior az and 
maximum number of supernovae iVsN- We assume z max = 1.5 and 5 C = 0.01 mag. Upper panel: 
the LH systematic is not included. Lower panel: the LH systematic is included. 
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4.3. Varying Asn and z max simultaneously 

To further investigate the interplay of Nq,n and z max , we varied them simultaneously while 
keeping the uncertainty on the zero-point prior az fixed at 0.005 and 0.01 mag. Again the inclusion 
of LH systematic changes the conclusion in each case. 

The results are shown in Table [SJ the contour plots drawn from the data in the table are 
shown in Figures [7] and [SJ the upper panels show results without including the LH systematic, the 
lower panels including it. Both panels in these figures show, unsurprisingly, a tradeoff between 
A^sn and z max . Without any redshift dependent systematic, for the higher FoMs (FoM <i 250 for 
az = 0.005 mag, FoM <i 245 for az = 0.01 mag) going to higher z max is not only ineffective, but 
even counterproductive: the optimum z max is about 1.4. The inclusion of the LH systematic, shown 
in the lower panels of the figures, changes this conclusion, showing once again the importance of a 
high z max : only high z max can achieve high FoM. Only if one is willing to settle for low FoM can 
one lower z max and compensate by an increase in AgN- We finally note that with the simultaneous 
fit calibration uncertainties are a subdominant component to LH in the error budget, whereas with 
the the SN by SN fit calibration uncertainties are dominant. 

5. Discussion and conclusion 

Adopting the general method of modelling zero-point uncertainties introduced by KM we have 
carried out simulations of a future space-based supernova dark energy experiment with the main 
aim of assessing the influence of zero-point uncertainties on its overall performance. We have 
confirmed KM results for a more realistic experiment: fitting for all supernovae at once results 
in a greatly improved mission performance over the traditional SN by SN fitting. Whereas this 
effect may not be evident in today's surveys involving a few hundreds of supernovae and few 
available bands, it will become very significant for future surveys. We explored a representative 
section of the mission parameter space paying particular attention to how zero-point requirements 
can be traded off with other mission parameters; in particular we have shown that in general 
going to higher redshift results in less stringent zero-point requirements, even without considering 
other form of systematic. We stress once again that, while our results are for a specific possible 
space-based mission, the KM model itself is more general. The inclusion of a redshift dependent 
systematic such as the LH systematic greatly affects the mission performance, both by significantly 
degrading the FoM and by making the case for higher redshift even stronger; it is therefore extremely 
important to better characterize other forms of systematic by the time future stage IV experiments 
get under way. Finally the tools used here can realistically simulate future dark energy supernova 
experiments. The work can be expanded in many ways, all easily implementable in our simulation 
tool. The most obvious examples are different mission architectures, both ground and space-based, 
different redshift distributions, further models of systematics. For the zero-point uncertainties one 
can explore tighter characterization in the optical vs the near infrared and variation with time. 
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Fig. 7. — Contours of constant FoM for different numbers of supernovae iVsN and maximum survey 
redshift z max at fixed zero-point prior uncertainty oz = 0.005 mag. We assume S c = 0.01 mag. 
Upper panel: the LH systematic is not included. Lower panel: the LH systematic included. 



-24- 




1500 1600 1700 1800 1900 

Number of Supernovae 



2000 




1500 



1600 



1700 



1800 



1900 



2000 



Number of Supernovae 



Fig. 8. — Contours of constant FoM for different numbers of supernovae iVsN and maximum survey 
redshift z max at fixed zero-point prior uncertainty oz = 0.01 mag. We assume S c = 0.01 mag. 
Upper panel: the LH systematic not included. Lower panel: the LH systematic included. 
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The latter may be especially relevant for ground-based surveys. A more detailed treatment of the 
nearby supernova sample would introduce a separate set of zero-point parameters; again this can 
be accommodated by the KM model. 

This work was supported by the Director, Office of Science, Office of High Energy Physics, of 
the U.S. Department of Energy under Contract No. DE-AC02-05CH11231. 
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Table 2. FoM of SN by SN fit vs. FoM of simultaneous fit, for color uncertainty S c = 0, 0.005, 

0.01, and 0.02 mag. 
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Table 3. FoM as a function of uncertainty on the zero-point prior for five different 
z max : 1.1, 1.2, 1.3, 1.4, 1.5. Upper panel: the LH systematic not included. Lower panel: the LH 
systematic included. In all cases iVsN = 2000 and 5 C = 0.01 mag. The nearby supernova sample is 

unchanged. 
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Table 4. FoM as a function of uncertainty on the zero-point prior for three different 
iVgN : 1500, 1800, 2000. Upper panel: the LH systematic is not included. Lower panel: the LH 
systematic is included. In all cases z max — 1.5 and 5 C — 0.01 mag. The nearby supernova sample 

is unchanged. 
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Table 5. FoM as a function of number of supernovae iVsN and maximum survey redshift z max for 
fixed uncertainty on the zero-point prior oz = 0.005, 0.01 mag. FoMs are reported both with and 
without including the LH systematic. We assume 5 C = 0.01 mag. The nearby supernova sample is 

unchanged. 



FoM 



NSN 


2- max 


oz = 0.005 mag 


oz = 0.005 mag 


oz = 0.01 mag 


oz = 0.01 mag 






No LH 


LH 


No LH 


LH 


1500 


l.l 


216 


159 


207 


154 


1500 


1.2 


227 


171 


218 


165 


1500 


1.3 


231 


179 


221 


172 


1500 


1.4 


232 


183 


221 


175 


1500 


1.5 


235 


188 


224 


181 


1800 


1.1 


235 


168 


227 


163 


1800 


1.2 


245 


180 


236 


175 


1800 


1.3 


253 


191 


243 


184 


1800 


1.4 


257 


198 


246 


191 


1800 


1.5 


256 


201 


245 


193 


2000 


1.1 


245 


172 


236 


167 


2000 


1.2 


259 


188 


250 


182 


2000 


1.3 


265 


197 


255 


191 


2000 


1.4 


269 


204 


258 


197 


2000 


1.5 


268 


208 


257 


201 



